We propose a temperature-insensitive refractive index (RI) fiber sensor based on a Mach–Zehnder interferometer. The sensor with high sensitivity and a robust structure is fabricated by splicing a short photonic crystal fiber (PCF) between two single-mode fibers, where two microcavities are formed at both junctions because of the collapse of the PCF air holes. The microcavity with a larger equatorial dimension can excite higher-order cladding modes, so the sensor presents a high RI sensitivity, which can reach 244.16 nm/RIU in the RI range of 1.333–1.3778. Meanwhile it has a low temperature sensitivity of 0.005 nm/°C in the range of 33°C–360°C.